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I. History and Background of NCLB 



he signing of the No Child Left Behind Act on January 8, 2002, 


moved the federal effort to influence K-12 schooling to a new 


I and higher level— more aggressive, focused, and directive. The act 
requires that school districts and schools demonstrate adequate yearly 
progress (AYR) toward a particular goal: universal student achievement 
of standards established by each state. Each year, school districts and 
schoolsthat do not achieve AYR will be labeled "Did Not MakeAYR," and 
after two such years they may suffer sanctions that include loss of fed- 
eral funding, termination of staff, and dissolving the school district. 

The new law was accompanied by promises of higher funding, both 
to enhance the prospects of success and to serve as an incentive for 
compliance. However, two years after NCLB was signed amid bipartisan 
euphoria and more than one year into implementation, its chances of 
success and prospects for increased funding are, at best, uncertain. In 
Indiana, for example,Title I funding has increased only 11 percent over 
the year before NCLB was signed; virtually all of that amount funds new 
programs mandated by NCLB; and members of the state's congressional 
delegation say that there is little prospect of increased funding in future 
years. Many educators suspect that NCLB may join special education as 
a major unfunded mandate. 

The fanfare that accompanied NCLB seemed to herald a new feder- 
al initiative. Technically, however, NCLB Is but the latest reauthorizatlon 
of the 1965 Elementary and Secondary Education Act. During the past 
thirty-seven years, it became the practice to assign each reauthorization 
a distinctive title: hence, 2001's"No Child Left Behind Act.” Each version 
of the ESEA has sought in particular to improve the achievement of low- 
performing students. Over the years an increasing emphasis on out- 
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comes culminated in the 1994 reauthorization (dubbed "Goals 2000”), 
which emphasized higher standards, testing based on those standards, 
and demands for accountability. Also along the way, federal frustration 
over a perceived lack of progress began to grow. 

That was the background against which the provisions of the 2001 
NCLB reauthorization were framed. Both presidential candidates in 2000 
had promised change and improvement in education. Upon taking 
office, the new Bush administration garnered support by focusing on the 
seductive promise that no child would be left behind. Those heady days 
of bipartisanship in education were symbolized by pictures of the pres- 
ident and a partisan archrival. Sen. Edward Kennedy, dining at the White 
House to discuss the future of K-12 education. 

II. The Problem with NCLB 

So just what is wrong with NCLB? To understand the answer, it's 
important to understand one of the act's major requirements (and great- 
est strengths): breaking out test scores by demographic groups— black, 
Hispanic, Native American, Asian, special education, LEP (limited English 
proficient), economically disadvantaged, and white. The act requires 
demographic breakouts in order to avoid a classic anomaly in education 
data: satisfactory overall group performance that simultaneously 
obscures poor performance by subgroups. Unreported subgroup per- 
formance is one reason U.S. society and policymakers have tolerated 
achievement gaps between certain subgroups— students living in pover- 
ty, blacks, Hispanics— and other groups, usually white or more advan- 
taged students. 

The strength of NCLB is in forcing educators to confront disparate 
student achievement. That strength is, however, negated by the act's sin- 
gle numerical goal for all groups and its requirement that each group 
reach 100 percent proficiency in twelve years, no matter the achieve- 
ment level at which it began. NCLB's single goal for all breakout groups, 
applied without concern for where a group starts or how much 
improvement it demonstrates, virtually guarantees immediate failure for 
school districts and schools that enroll high percentages of the most 
challenged students. (See Part IV, "Calculating Your District'sAYP.”) 

The single-goal approach also guarantees that students who have 
had the greatest difficulty achieving must demonstrate the greatest 
progress. Virtually all the research on aspiration and student achieve- 
ment has found, however, that improvement must be measured against 
the point at which the student begins; that it is hard work; that it comes 
unevenly, w ith significant gains accompanied by plateaus and temporary 
setbacks; and that improvement requires ongoing effort and commit- 
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merit. The literature as well as direct professional experience and com- 
mon sense tell us that both effort levels and chances of success are 
enhanced by goals that force stretching but are nonetheless, given 
enough effort and commitment, within reach. 

UnwpoTted subgmup performance is one reason U.S. society 

and policymakers have tolemted achievement gaps between 
certain subgroups— students living in poverty, blacks, 
Hispanics—and other groups. 

The NCLB scheme, ignoring the research consensus, assumes that 
improvement is continuous and consistent and that goals can be reached 
in a fixed time, regardless of the distance to be traveled. It says, simply, 
that we use 2001-2002 as the base year and progress in equal annual 
steps for twelve years, when 100 percent proficiency will be achieved. 
At the risk of oversimplifying, measuring improvement from the point 
at which the sdiool district, school, or breakout performance begins, 
using measures based on same-student performance, would avert the 
NCLB's harshest consequences almost immediately. The school -improve- 
ment plans of Indiana and several other states already employ such an 
improvement focus. 

However, even with realistic performance goals and measurements 
based on improvement by same-student cohorts, the issue of what con- 
stitutes realistic achievement will have to be addressed. This writer has 
yet to encounter a single person who believes that 100 percent profi- 
ciency for all students is a realistic or reachable goal. 

III. Applying NCLB to Indiana: A Hypothetical 

A good place to examine the potential impact of NCLB is in my 
home state of Indiana, one of the earliest states to embrace the account- 
ability movement. Structured efforts to improve student achievement in 
Indiana began in the mid- to late 1980s. Indiana became one of seven- 
teen states that complied fully w ith the provisions of the 1994 initiative. 
Goals 2000; when NCLB was signed in 2002, Indiana had already been 
measuring its own AYR benchmarks for four years. In addition, Indiana’s 
Public Law 221, passed in 1999, places schools in categories based on 
improvement shown, with the first such placements to be made after the 
fall 2005 testing. Under RL. 221, student progress for grades 3 to 10 will 
be assessed through same-student comparisons that use year-to-year test 
scores. In 2000, a graduation-qualifying exam at grade 10 was im- 
plemented, with few of the problems encountered in other states. 

The passage of NCLB provided good news immediately for Indiana’s 
budgetary woes: the funding needed to support the planned expansion 
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of ISTEP (Indiana Statewide Testing for Educational Progress) testing. 
The Indiana Department of Education (IDOE) accepted the chalienge of 
NCLB and began planning to implement NCLB. The IDOE planning 
effort involved all those interested in K-12 schools (including the 
author, as a consultant to the Indiana Urban SchoolsAssociation [lUSA]). 
As a result, Indiana became one of five states placed on the fast track for 
federal approval. 

As familiarity with the demands of NCLB grew, however, the law's 
ultimate feasibility came into question in many quarters. During that 
period, I developed and made several presentations on implementing 
NCLB in Indiana. In the process I used the results of the ISTEP tests 
given in September 2001 to calculate AYP for the participating schools 
(at that point, Indiana's AYP determinations for the NCLB base year, 
2001-2002, were not yet made). I planned to use the figures to provide 
specific examples of the way AYP data could be used to focus instruc- 
tion. Soon, however, I realized that NCLB'sAYP calculations doomed the 
vast majority of schools and virtually every school district in Indiana to 
failure, with the schools that serve the highest percentage of challenged 
students achieving failure first. 

In general, I concluded that applying NCLB to Indiana using 2001 
data without mitigating measures would produce drastic and unexpect- 
ed results. Here are the projections I made for Indiana school districts 
and schools based on the 2001 test data: 

• Two hundred sixty-nine of the state's 293 school districts would 
have failed to achieve AYP. 

• The twenty-four school districts that would have achieved AYP 
had an average enrollment of 770 students and an average minor- 
ity enrollment of 1.7 percent. 

• Each of the thirty school districts in the Indiana Urban Schools 
Association would have failed to make AYP. (The thirty-four lUSA 
school districts tested 93.8 percent of the state's black students, 
68.2 percent of the Hispanic students, and 56.4 percent of the 
free- or reduced-lunch students.) 

• Sixty-eight percent of the schools in the lUSA would have failed to 
achieve AYP. 

• The failing schools in the lUSA would have included 95 percent of 
the high schools, 92 percent of the middle schools, and 57 percent 
of the elementary schools. 

Those results reflect a particularly pernicious consequence of the 
way AYP is to be calculated. As mentioned earlier, larger schools test 
more students, which means more breakouts and a greater chance of fail- 
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ure to achieve AYR Larger numbers tested also mean that less relief will 
be gained from applying the test of statistical significance, a test used to 
guarantee that differences are real. In addition, NCLB applies a single 
goal without concern for where a group starts or how much improve- 
ment it demonstrates. Therefore, when diversity adds more students 
who start far from the goal, the odds of achieving AYR diminish. At the 
school district level, achieving AYR in Indiana is almost beyond reach. 

To see w hy it is vital to take into account both the starting point and 
the ability of the students in a breakout group, let's examine how the act 
would treat Indiana's special education students. The data for special 
education students in Indiana measured in the 2001 ISTER testing 
showed that 252 of the 256 breakout groups would have failed to 
achieve AYR. (Communities with high socioeconomic levels furnished 
the four breakout groups that would have achieved AYR, which leads me 
to speculate that the basis of their special education placement was 
something other than cognitive ability.) 

Most of Indiana's special education breakouts in 2001 would have 
missed NCLB targets by twenty to forty percentage points. Even taking 
into account NCLB's alternative assessments for some special education 
students, it appears that, regardless of the effort put forth, most special 
education breakout groups will not meet NCLB's standards. Special edu- 
cation groups will bear the brunt of the failure of school districts and 
schools to make AYR. It is difficult to believe that such a result is good 
for either special education or the school-improvement effort. 

Given such projections, the logical question becomes: "Will any 
purpose be served by giving the schools that enroll a high percentage of 
disadvantaged and minority students a label that will be equated with 
'failing'?" After all, Indiana's recent scores on the National Assessment of 
Educational Rrogress (NAER) and other external measures suggest that 
the state's students have performed well in comparison to students in 
other states and consistently improved in recent years. 

I realized that NCLB's AfP calculations doomed the vast 
majority of schools and virtually every school district in 
Indiana to failure. 

But beyond that, if the "retro” exercise in applying NCLB to Indiana's 
2001 numbers proves anywhere close to accurate, NCLB's methodology 
guarantees that matters will progressively worsen. For reasons related to 
the state of technology, more grades will be added to the testing pool 
each year,so "Did Not Make AYR"— which will be understood by every- 
one to mean "This school district or school is a failure"— will occur more 
often each year. The handful of school districts and schools left standing 
in 2005 will then be further challenged when, in compliance with NCLB, 
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the goals will jump by 25 percent of the difference between the initial 
goals and 100 percent proficiency. 

Due in part to abbreviated media coverage, few people realize that 
AYP determinations and the possibiiity of improvement and corrective 
action status appiy not only to schools but to school districts. AYP and 
NCLB sanctions may, in fact, prove most severe and immediate at the 
schooi district ievei. A district that fails to achieve AYP for two consecu- 
tive years wiii move to "schooi improvement" status. It must, at that 
point, work with the state to deveiop a pian for achieving AYP. A school 
district failing to make AYP for the fourth consecutive year moves to 
"corrective action” status, which under NCLB authorizes the state to 
exercise one of seven options: 

• Reduce programmatic or administrative funds. 

• Replace the curriculum. 

• Terminate personnel relevant to the failure. 

• Move some schools from the jurisdiction and provide aiternative 
governance. 

• Appoint a receiver to replace the superintendent and the board. 

• Abolish and restructure the schooi district. 

• Provide choice for school district students to attend successful 
neighboring school districts. 

How does Indiana pian to proceed in reiation to the seven options? 
The indication to date has been that none is permissible under Indiana 
iaw and that virtually all the state will be able to do is consult with school 
districts on how they spend their money. Given the federal government's 
supremacy in distributing money, that statement is of little comfort. 

In early 2003 I spoke to twenty relatively small school districts. Six 
of those districts will undoubtedly fail to make AYP— even though every 
school in them will achieve AYP. Think of that in terms of the purposes 
for which the school district exists! 

IV. Calculating Your District's AYP 

Judge NCLB and itsAYP system not in the abstract or based on what 
others say. To really understand AYP, familiarize yourself with the 
process. Take actual data for school districts and schools with which you 
are familiar, and calculate AYP. 

I have calculated AYP several thousand times for school districts and 
schools with large enrollments, small enrollments, great diversity, and lit- 
tle or no diversity. That hands-on experience has led me to conclude that 
the NCLB'sAYP system will prove useless for improving student achieve- 
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merit. AYP targets not individual students but school districts and 
schools, and it effectively guarantees that virtually all of them will be 
labeled failures. That inevitability derives from the mandated mechanics 
of AYP. 

Jhe mechanics of The overall group and each breakout group 
in a school district or school are required to meet goals specifying the 
percentage of students who must pass the state tests on English and 
math. The goals are fixed by the state using a formula prescribed in 
NCLB. The goal is the same for all groups. 

To determine if your school achieved AYP, you start with the overall 
group and ask, "Did the group make the goal in English?" If the answer 
is yes, you ask the same question for math. If the answer again is yes, you 
have two yeses. Now move to the first breakout group. A breakout group 
is any group— say, students with disabilities— for which the number of 
students tested in the school district or school is greater than the thresh- 
old number (the "N") stated in the state plan. In Indiana and most other 
states the N is 30. Ask the same two questions for the first breakout and 
then repeat the process for each of the other breakouts. The first "no" 
answer means that the school district or school did not make AYR* 


A predominantly white dementary school with an 
enrollment of 250 or less will seldom miss achieving AldP 
because it won't contain groups large enough. 

The typical urban school district in Indiana includes between four 
and seven breakout groups. The more breakouts, the more difficult it 
becomes to make AYP. In a school district or school with every one of 
the eight breakout groups, it will be necessary to answer "yes" eighteen 
times (twice for the eight breakout groups, and twice more for the over- 
all group) to meet AYP based on test data alone. But for those with all 
yeses o n th e q u esti on s rel ated to test d ata, th ere are sti 1 1 h u rd I es to j u m p . 
To protect against the possibility that school districts or schools might 
hold low-achieving students out of the testing, NCLB's authors included 
a requirement that 95 percent of the overall group and 95 percent of all 
students in each breakout group must be tested in English and 95 per- 
cent in math. The N required for a breakout differs from state to state. In 
Indiana, it is thirty students tested. Apply that standard next. That adds 

♦In calculating AYP, consider the compound probabilities alone: if every group has a 99 percent chance 
of making AYP— nearly ideal conditions that are rarely seen— the odds that all thirty-seven groups will 
achieve AYP are equal to .99 to the 37th power, which is 0.689, or only slightly more than two out of 
three. Thus, despite the fact that our hypothetical school is nearly ideal, there is a nearly one in three 
chance that it will not achieve AYP. If each breakout has an 80 percent chance of making AYP— prob- 
ably not bad in the real world— the chances that all thirty-seven will achieve AYP are fewer than 3 in 
10,000. If one does not consider that situation impossible, factor in that the reason for defining a break- 
out group in the first place is usually to focus on students who have historically underachieved.— Ed. 
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two more required yeses for the overall group and two for each break- 
out group, bringing the number to thirty-six for a school district or 
school with the full complement of breakouts. 

NCLB also requires at least one secondary indicator for each school. 
At the high school level, It must be the graduation rate. For other 
schools, the secondary Indicator is determined by the state. Indiana's 
goal Is a graduation rate of 95 percent for its high schools and 95 per- 
cent average daily attendance for all other schools. The secondary indi- 
cator, at least in Indiana, applies only to the overall group, thereby 
bringing the possible number of yeses required to thirty-seven. 

It is plain to see how small schools with little diversity can achieve 
AYR White breakouts achieve AYR A predominantly white elementary 
school with an enrollment of 250 or less will seldom miss achieving AYR 
because it won't contain groups large enough. Given the N of 30 used 
in most states, it will have few. If any, breakouts. Case in point: the prin- 
cipal of an elementary school studied the data, realized his 600-plus-stu- 
dent elementary school would not make AY Rand called me to say,"lf we 
split this school into three schools in the same building, we wouldn't 
have any breakouts and all three would make AYR." 

Extend the game as long as you can. It Is an interesting, albeit per- 
verse, exercise to see how far any school or district can "drill down" into 
its breakout groups before it fails. The first rule in extending the game is 
to avoid beginning with the special education breakout. Most school dis- 
tricts and large schools have such breakouts and few will make AYR. As 
already noted, using the 2001 data, 256 of Indiana's 293 school districts 
would have had special education breakouts in the 2001 testing, and all 
but three would have failed to achieve AYR. I used the more-recent 2002 
ISFER data to calculate AYR for the thirty-four school districts in the 
Indiana Urban Schools Association. Had 1 started with the special edu- 
cation breakouts,! would have Identified each of the school districts as 
"Did Not Make AYR." The game would have been over. 

Absent significant change, NCLB will at minimum 
fail to improve schooling and do nothing to aid 
low-performing students. 

To extend the game one must carefully choose the order In which 
the breakout groups are taken. If Indiana is a typical state, the breakout 
for Asians is a good place to start. That group is likely to score highest in 
terms of the goals. The white breakout also will earn two yeses in most 
schools. From that point on, the prospects of making AYR are iffy; none- 
theless, there Is much to be learned from extending the game. For exam- 
ple, free/reduced-lunch, Hispanic, black. Native American, and LER 
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groups are among the least likely to make AYR The finding should not be 
surprising given what we know about the achievement gap. 

Drilling down further, however, you will quickly conclude from the 
free/reduced-lunch percentages that there is legal poverty and then 
there is real poverty. Free/reduced-lunch groups in urban areas are 
unlikely to achieve AYR while their counterparts outside the urban areas 
sometimes outperform the paid-lunch group. Therefore, Hispanic and 
black students in school districts with high socioeconomic levels are far 
more likely to achieve AYR than their counterparts in school districts 
serving students from lower socioeconomic levels. 

As you drill down into your own data, you gradually become aware 
of a paradox: as the information you acquire about the correlates of stu- 
dent performance in your ow n schools becomes more textured and valu- 
able, the notion of measuring school performance with the types of tests 
mandated by NCLB becomes less plausible. That realization made it eas- 
ier for me to accept the overall conclusions of my analysis. Even w ithout 
including special education, thirty-two of the thirty-four Indiana Urban 
Schools Association school districts were ultimately identified as "Did 
Not Make Adequate Yearly Progress." The special education breakouts 
made it unanimous. 

Safe harbor or Russian rouIette?To be fair, it must be noted that 
NCLB includes a "safe harbor” provision that schools can use to make 
AYR. Safe harbor is reached if the actual percentage of students failing a 
given test is reduced by 10 percent. Note that the percentage itself must 
be reduced, not the number of students. To maintain rigor where safe 
harbor is used to make AYR, NCLB requires that any group using AYR to 
reach safe harbor must also satisfy the secondary indicator. It is the only 
time that secondary indicators come into play for breakout groups. 

At best safe harbor is a Russian roulette kind of process because, in 
different years, the students will be different, the "N 's" may be different, 
and the demographics of those tested may change. However, that is not 
why I downplay the safe-harbor provision here. I do so because urban 
school districts and schools in Indiana and most other states will miss 
AYR in multiple instances, leaving moot the issue of safe harbor in rela- 
tion to a specific percentage. 

V. Where Do We Go from Here? 

Looking back, it is easy to see that my initial positive reaction to 
NCLB was based on general support for the act’s goals and incomplete 
understanding of the specifics of implementation. One early warning 
sign of NCLB's deficiencies was its goal of 100 percent proficiency; none- 
theless, many supporters, including this writer, generally withheld com- 
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merit, confident that the matter could be addressed later. /'Congress may 
consider changes in NOB beginning in 2007, when the act comes up 
for reauthorization.— Ed.] One hopes that such thinking does not 
prove wishful. 

We have a saying in Indiana: "That dog won't hunt.” Putting it blunt- 
ly, the current No Child Left Behind Act merits that description. Absent 
significant change, NCLB will at minimum fail to improve schooling and 
do nothing to aid low-performing students. In the worst<ase scenario, 
NCLB could do serious damage to the school-improvement effort nation- 
ally and to the promising efforts already under way in states such as 
Indiana. The students most in need of help would be the biggest losers. 

Where, then, do NCLB and AYP leave us?There Is much in NCLB to 
like and embrace. The focus on "leaving no child behind"— systematic- 
ally identifying and then addressing the needs of low-achieving stu- 
dents— is still a worthy if distant goal. Analyzing test scores, especially 
those of subgroups, is so basic to improving achievement that it is diffi- 
cult to understand why its implementation required a federal mandate. 

The prospects for change depend on many factors, among them 
political w ill; the w lllingness to face the fact that changes are needed; the 
staying power of those promoting change; and the true motives of those 
responsible for NCLB— whether they were good intentions marred by 
haste, disappointment over the results of past legislation, or even a desire 
to create a stalking-horse for vouchers. If the provisions of NCLB as they 
stand at this writing are not changed, the greatest consolation for the 
education community and all concerned may be that the results of NCLB 
will so lack credibility that they will be not be taken seriously In that 
event, NCLB will go down as one of the greatest missed opportunities in 
the history of American education. 
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